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ABSTRACT 



This document describes procedures utilized during the 1971-72 



IMS system exercise to record and monitor the flow of data gathering 
forms. Mailing, logging, pre- and post-processing and filing 
operations are discussed sequentially. Examples of forms are 
included. 
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.L97lr72 IMS COMSYS 1 AND II OPERATIONS GUIDE 

INTRODUCTION 

Alternative methods were considered in establishing the procedures 
utilized during. the 1971-72 IMS system exercise to record and monitor the 
flow of data gathering forms. The methods selected were required to be 
flexible enough both to meet the criteria set by IMS and the Computing Center 
and to be modified as the tryouj;t evolved* -Grobe's description (TN 5-72-03) 
oi" the. projposed operating procedures for creating the^data base, for input 
and output, should be read to place this document in perspective. After the 
procedures were defined, proposed and approved, responsibility for the 
various tasks was assigned to two members of the Computing Center and IMS 
staffs;*, the -Data Processing and IMS Clerk.. . 

This operations guide describes th^bif functions separately, although 
frequently their responsibilities overlapped or were exchanged. Section I 
describ^ the optimal conditions of IMS 1971-72 system exercise and each 
operational phase is discussed sequentially. The second section deals with 
the operational problems encountered during the tryout and lists possible 
preventative measures. Examples of the logging forms, sample pages from the 
clerk's notebooks and charts appear in the third section. 

T. IMS FORMS HANDLING PROCEDURES 

Training Materials 

Materials wera assembled by the IMS clerk prior to each training session 
and distributed to the teachers by IMS and DRS staff members. The teachers 
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were provided with portfolio folders 'to store their training materials • 



The following forms were included in the t^raining packets: 



FYCSP: 



Class Record Sheet 

Class Record Sheet Directions 

Criterion Exercise 

Criterion Exercise Directions 

Practice Criterion Exercise 

Practice Criterion Exercise Directions 

Criterion Exercise. Cards 

ID Sheet 

ID Sheet Directions 
Fre-addressed mailing envelopes 



Class Record, Sheet Directions ^ 
— Criterion Exercise Sheets - \ - ^ 

Criterion Exercise Sheet Directions 
Pupil List 

Pupil List Directions 
ID Sheet' 
' ID Sheet Directions 

Pre-addressed mailing envelx^pes 

Questionnaires were given to each teacher attending the training session 
which provided information about grade level, program, class time, and current 
instructional unit. The IMS Clerk transferred that information from the 
quoHMtinn.'irlo to tho two copies (original and carbon) of the Class Record Sheet 
UoLh copies wore Lliei>^mai led to the teacher and the carbon' copy was returned to 
SWRL in the pre-addressed envelope provided. In most cases the Class Record 
Sheets were returned promptly and were completed correctly. The date 
the Class Record Sheet was received at SWRL was noted in the Forms Control 
Log (Figure 1) . 

Initial Mailing of IMS Forms / 

The next step involved mailing appropriate materials to each teacher. 
The teacher questionnaire enabled the IMS clerk to correctly assemble the 
materials listed below. 



LMS: 



.Class Record Sheet 
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3 units (40 sheets each) Criterion Exercise Sheets 
40 IMS Identification Sheets 
10 pre-addressed mailing envelopes 
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' 3 units (10 sheets each) Criterion Exercise Sheets 

6 Pupil Lists ' . .■ * 

i 

40 IMS Identification Sheets 
10 pre-addressed mailing envelopes 
These materials were mailed directly to the teacher in 10" x 14" envelopes. 

Prior to the introduction of the teacher questionnaire, the teachers 
relayed identifying dnformation (i.e., program, unit number, class time) through 
their principal to SWRL. Based on that preliminary information the appropriate 
IMS materials were taken to the training s^Ssi^s and given to the teachers at 
that time. In either case the date the materials were given to the teachers 
was noted in the Forms Control Log by the IMS clerk. 

Return Envelopes ^ 

Pre-addressed envelopes for returning Criterion Exercise Sheets ^were 
mailed to the teachers in increments of 10 each. 

— . 

Loggin}^ of IMS Forms 

As the Class Record Sheets and Criterion Exercise Sheets were ^eived 
they were logged- in by the IMS clerk. The Forms Control Log (Figure 1), 
organized by district, school and teacher, was used to record each completed 
unit by the date it was received. A second log (Figure 2) was kept on a 
keypunch form to record teacher, school, district, program, grade, unit number, 
and testing, mailing, and receipt dates. Problems with t^e data (erasures, . 
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missing ID Sheet, etc.) were also noted on this log. A third log (Figure 3) 
was kept informally in notebook form by the IMS clerk to record teacher errors. 

A 

Such problems as stapled criterion exercise sheets, incorrectly used IMS forms, _ 
or missing ID Sheets were, listed by date.* , 

Preprocessing of .Raw Data by IMS ClWrk 

After the criterion exercise sheets were, logged, the IMS clerk completed 
the initial preprocessijV effort . The data were checked for teacher-generated 
errors such as incorrect use of IMS forms or incorrect procedures. As many 
corrections as possible were made by ihe IMS clerk who then contacted each 
teacher by telephone regarding errors made.. For example, the IMS clerk reminded 
a. teacher to include an Identification Sheet with the criterion exercise sheets . 
The clerk then supplied the nissing Identification Sheet and completed the test 
date information, 

Raw^Data Sent to Data Processing Clerk for Preprocessing 

The data were sent daily to the person responsible for preparing a scan 
tape. The Data Processing Clerk (DPC) continued preprocessing by checking the 
quality of the response cell marks and for holes in the test sheets. The data 
were thoroughly checked for stray marks, double marks and smudged erasures, 
which were erased and then whited-out with liquid paper, a process which took 
approximately one hour per IMS run. Pupil Codes on the FYCSP and HR-3 criterion 
exercise sheets were checked by the Data Processing Clerk and missing Pupil 
Codes were completed from Class Record Sheet information. Pupil Codes on 
Side One of the FYCSP Criterion Exercise were compared with those on Side Two 
for accuracy. The DPC also darkened those teacher or pupil marks which were 
too light to be read by the optical' scanner. 
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Occasionally the DPC required information from a teacher, in which case 
the IMS clerk would contact the teacher and relay information to the DPC. 

Optical Scanner Operation 

..-With the raw data prep recessed, the DPL initialized the optical scanning • 
operation (Cooper, TN 5-72-26). The tape number and the date of scanning 
were logged on the IMS Run Control Sheet-II (Figure 4). The DPC also kept 
an informal notebook (Figure 5) which described the preprocessing problems 
and scanner difficulties by run number and date. 

Data Input Tape 

The data input tape was made by the DPC from the sCv^n tape by .using the 
OpScan Program. The date and tape number were logged on the IMS Run Control 
Sheet-II Form (Figure 4). The data generated from the input tape was checked 
by the DPC to assure that all forms were scanned and all classes .were included^ 

Reports 

The clat.n Inpul l;ipt» wan "then processed through lUS to UCLA. The IMS 
rrporis wrn- Konerrttiul and printcJ.at SWRL. The Data Processing Clerk checked 
the reports to assure that header information, dates, format, error messages 
and run messages were correct. If a processing error appeared in the reports, 
the DPC resubmitted the forms in the next run. The multiple copy reports were 
run through the decollator and detacher machines, "^he Data Processing Clerk 
wrote the run number on the, IMS copy of each report and sent that copy to the 
IMS clerk for filing, 

Mailing and Filing Reports 

IMS reports were mailed to each teacher in care of her respective 
principal by either the DPC or IMS clerk. Each teacher; received his first 



report in a personalized grey binder. An IMS copy of each report and the 
original- data were filed at SWRL behind the appropriate teacher, school and 
district. Each report mailed was noted by the DPC in the informal log book. 

II.' OPERATIONAL PROBLEMS 

.The procedures established prior to the start of the 1971-72 IMS 

system exercise proved to be flexible enough both to record and monitor the 

/ 

flow of data gathering forms and to handle problems encountered during the 
tryout. From the viewpoint of the IMS and Data Processing Clerks, these 
problems were not unsolvable or unexpected, only time-consuming.' The majority 
of errors were '^teacher-generated" and could have been prevented had the 
teachers involved in the tryout: followed more carefully the instructions given 
to them during training sessions. The IMS Clerk functioned as a liaison 
between IMS and the teachers by reinforcing the training instructions through 
telephone contact' with the teachers. The teachers were cooperative iii most 
cases, ,The major teacher generated errors which slowed the pre-pro^cessing 
effort are listed below by form. 

IMS Identification Sheet . The most prevalent error was not including 
an Identification Sheet with the Criterion Exercise Sheet. If the teachers 
did not write her return address on the outside envelope the material was 
difficult to identify. Teachers also used the ID sheet as an update form to 
add a pupil to the data base without also including an ID sheet as a cover 
sheet to indicate the test date. This problem decreased during the later , 
months of the tryout but occured 35 times .ambng_the''76 participating teacher^. 
Other problems connected with the ID sheet included: 
.one ID sheet per student accompanying criterion exercise sheets 
rather than one ID sheet per test batch. 
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test date not indicated on the ID sheet or, if entered, 
improperly coded 

"add'^ pupil box not darkened when used as an update form 
Criterion Exercise Sheets , 
FYCSP 

, Pupil Codes ^not marked 

. Studencs "coded" their own criterion exercise sheets 
• . "Delete" box not marked when a pupil was to. be omitted 
I from the class roster- 

. Double marks by the pupils. If neither was X-ed qut or circled, 
the Data Processing Clerk had to- determine which ^he was ^ 
intended to be correct . / ' 

■ . . - ^ I 

. Holes in the sheets caused by erasures or pencil marks 
. Marks made by the pupils' close to the pre-coded unit field 
whirl] cniiKod the scanner to read a different unit number 
!;imi(lj.'t*<l t)r wMwmy marks close to the re«pon«c cell which had^ 
to be erased and then covered with white liquid paper 

LMS I ^ ^ ^ ' ' 

. Pupil List not marked 
.'"Tested" or "Delete" "box , not' marked . 

. One criterion exercise used per pupil rather than scoring 
10 pupils per page 

Cl ass Record Sheet 

, original rather than carbon copy mailed to SWRI^ 
, lines skipped to indicate grouping which changed the 
sequen^ce of - the pupil numbers 
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. IMS forms 


stapled together, which produced 


a' scannable hole 
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from the teacher 'to the IMS clerk 


written on scannable 
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FIGURE 3 



TEACHER 

^Davids 
Phillip 
Baker 



Martinez 
Washington 
North 
Abfams 



PROBLEM 



one Criterion Exercise shet^^^not coded 
^ mailed practice criterion exercise sheets 



no ID sheet; Pupil codes not coded 
Pupil id's not coded on second page 



Parker ' 

_Mat:tlnez 
Woods 
Claremont 

Stokely 
Williamson 

Abrams 

Baker 

Tate 

Washing toil 
Bernstein 

Allen 

Vesey 



xuvj date not indicated. 

One ID sheet per pupil; pupil ID' s not coded 
no ID Sheet 

One; ID sheet per pupil; skipped lines on 
.Class Recctd Sheet • 
no lb sheet 

Returned both copies of Class Record Sheet 

Pupil id's hot coded on* second page; 

date coded incorrectly ^ , 

no ID sheet; Pupil codes not codedi 

_ / • \ ' 

Wrote on scan field of FYCSP Criterion 
Exercise sheet to score each test 
no ID sheet:; used ink to code test date 
One ID sheet per pupil . j 



Drew line thru response box. to delete 
kids on Criterion Exercise sheet 
Used Unitr 5 instead of Unit 2 Criterion 
Exercise sheets 
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Figure 4 
XlMS RUN CONTROL SHEET - II 
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IMS RUN 
TYPE- - NUMBER, 



' 2-4 



Scanner Station 



Optirator Name 



Date 



/ 



Number of Scan 
Reruns 



Source Scan Tape No. 



□ 



Mo. 



Day 



1st Run 



2nd Run 



AVERAGE 



' Scanner , Time On (T6') 
/0/f^7) 
Operating Time^(T7-T6) 



Hrs. Min. 



^Hrs, Min, 



Hrs, Min, 



Comments ; 



69 0 Station 

r— — • — I 

Sciiii-T.ipr I'rocossor 

/ 



Number of Processing Reruns 



Date 



Mo, 



Day 



Scores Data Input Tape No. 
Pupil Data Base Tape No. IMS DB 



RJS Operator 



Date 



/ 



Day 



' Mo. 

Time Line Up (TS) 

Report Output 
Tape .EOF Time (T9) 



Comments: 



lirs, 



Min ♦ / 



Number of Transmission 
Failures 



Report Output Tape No, 



9-10 



14 



r 

^ 



FIGURE 5 



Run 10 



pre-processing 



Woods - marked the new pupil box on cover sheet, but did not 
add pupil, erased the mark 



Vesey -\she wrote the 24th on the cover sheet, but coded it 
tas the 26th - corrected 



made the scan tape (2/2/72 - in making it I noticed the scanner missed 
a page; re-scanned 2/3/72 

ran the Opsn program and made the data input tape 2/8/72; checked the 
printout and everything looks good 

submitted to RJS 2/8/72^ - printout came back 2/8/J2 and everything 
looked good^ reports checked out and messages are OK. 
The clerk is giving Wood a call to remind her she doesn't 

^ need to mark the delete box after deleting the student 

the first time - just leave it blank 

reports were print?ed on report ^p^fi'er, prepared for mailing and 
mailed 2/9/72 ^ 



Ruii 14 

pre-processing 

Mason - marked 2 different ID #*s for 1 student; it was looked 
up on the class roster and corrected 
- also, 2 students marked 2 answers arid crossed out 1, they 
did not erase ' 

made the scan tape 2/14/72 

made the data input tape 2/14/72 - printout of the data input tape 
I looked good 

submitted to RJS 2/17/72 - came back 2/17/72; losted the reports and 

checked them over, looked good 



processed, prepared, and mailed reports 2/18/72 
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FIGUR^ 6 
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Flowchart Layout Form 



I * K c G f< A M t R : 
Pr o o « a m . ib: 



Da T c : _ _ ... 
Pa oc or 



Teacher 



,^ ■■ 

/CE's 6* ID 

/sheets ass^n- 

"7bled 6 mail 

/date logget^ 



//yntnlster j 
CE's 



CE's 
Logged -in 



Teacher ^ 



Problems 
"Quoted and 
com c ted i 



/ CO 



End ^ 



C.E. 's 

sont to 



/ Her^rts 
7 filed 
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Data 
Process ing 
Clerk 



Pre-procosslni ; 





/ checking 
' data input 
cape list/ 





f 


Process 
Input 
Tape 






f" ^ 

Rcpo 
gener 


res 
a ted 



Error 
/check the 
' reports 



IT 




Moll 
' reports to^L 
teachers 



Run ^ 
marked on 
IMS copy 



